Amplifying The Uncanny

Deep neural networks have become remarkably good at producing realistic deepfakes, images of people that (to the untrained eye) are indistinguishable from real images. Deepfakes are produced by algorithms that learn to distinguish between real and fake images and are optimised to generate samples that the system deems realistic. This paper, and the resulting series of artworks Being Foiled explore the aesthetic outcome of inverting this process, instead optimising the system to generate images that it predicts as being fake. This maximises the unlikelihood of the data and in turn, amplifies the uncanny nature of these machine hallucinations

Trends and Anti-Trends in Techno-Art Scholarship: The Legacy of the Arts “Machine” Special Issues

With the goal of casting a spotlight on the posture of the creative community at this crucial moment in human technological history, we present herein a thematic overview of the 23 articles published in the recent Arts Special Issues “The Machine as Art (in the 20th Century)” and “The Machine as Artist (for the 21st Century)”. Surprisingly, several of the themes that had been suggested in our two introductory essays as representing shared and positive points of departure—in particular, (a) the visual arts as a longstanding touchstone of human culture, (b) the visual arts (with the example of John James Audubon) as having a unique ability to rally the public to the environmental cause, and (c) computer and robotic proficiency in the arts as leading to a friendlier artificial intelligence—received less than the expected amount of attention. Instead, it was another of the suggested themes (albeit also of a positive and forward-looking nature) around which our authors coalesced, as expressed in the following phrase: the “vast expansion of the creative sphere” which technology has made possible, or in other words, the idea that technology is not only providing new horizons for the professional artist but is also providing new avenues for the non-professional to discover his or her creative potential. In light, furthermore, of the marked enthusiasm for this theme, we suggest in our conclusion the need for a corresponding expansion of the venues available to both professional and non-professional techno-art practitioners

Towards Friendly Mixed Initiative Procedural Content Generation: Three Pillars of Industry

While the games industry is moving towards procedural content generation (PCG) with tools available under popular platforms such as Unreal, Unity or Houdini, and video game titles like No Man’s Sky and Horizon Zero Dawn taking advantage ofPCG, the gap between academia and industry is as wide as it has ever been, in terms of communication and sharing methods. One of the authors, has worked on both sides of this gap and in an effort to shorten it and increase the synergy between the two sectors, has identified three design pillars for PCG using mixed-initiative interfaces. The three pillars are Respect Designer Control, Respect the Creative Process and Respect Existing Work Processes. Respecting designer control is about creating a tool that gives enough control to bring out the designer’s vision. Respecting the creative process concerns itself with having a feedback loop that is short enough, that the creative process is not disturbed. Respecting existing work processes means that a PCG tool should plug in easily to existing asset pipelines. As academics and communicators, it is surprising that publications often do not describe ways for developers to use our work or lack considerations for how a piece ofwork might fit into existing content pipelines

A Machine Learning Application Based on Giorgio Morandi Still-Life Paintings to Assist Artists in the Choice of 3D Compositions

The authors present a system built to generate arrangements of threedimensional models for aesthetic evaluation, with the aim being to support an artist in their creative process. The authors explore how this system can automatically generate aesthetically pleasing content for use in the media and design industry, based on standards originally developed in master artworks. They then demonstrate the effectiveness of their process in the context of paintings using a collection of images inspired by the work of the artist Giorgio Morandi (Bologna, 1890–1964). Finally, they compare the results of their system with the results of a well-known Generative Adversarial Network (GAN)

Creative Machine

Curators: William Latham, Atau Tanaka and Frederic Fol Leymarie A major exhibition exploring the twilight world of human/machine creativity, including installations, video and computer art, Artificial Intelligence, robotics and Apps by leading artists from Goldsmiths and international artists by invitation. The vision for organising the Creative Machine Exhibition is to show exciting works by key international artists, Goldsmiths staff and selected students who use original software and hardware development in the creative production of their work. The range of work on show, which could be broadly termed Computer Art, includes mechanical drawing devices, kinetic sculpture driven by fuzzy logic, images produced using machine learning, simulated cellular growth forms and the self-generating works using automated aesthetics, VR, 3D printing, and social telephony networks. Traditionally, Computer Art has held a maverick position on the edge of mainstream contemporary culture with its origins in Russian Constructivist Art, biological systems, “geeky” software conferences, rave / techno music and indie computer games. These artists have defined their own channels for exhibiting their work and organised conferences and at times been entrepreneurial at building collaborations with industry at both a corporate and startup level (with the early computer artists in the 1970s and 1980s needing to work with computer corporations to get access to computers). Alongside this, interactive media art drew upon McLuhan’s notion of technology as extensions of the human to create participatory, interactive artworks by making use of novel interface technology that has been developed since the 1980s. However, with new techniques such as 3D printing, the massive spread of sophisticated sensors in consumer devices like smartphones, and the use of robotics by artists, digital art would appear to have an opportunity to come more to the fore in public consciousness. This exhibition is timely in that it coincides with an apparent wider growth of public interest in digital art, as shown by the Digital Revolution exhibition at the Barbican, London and the recent emergence of commercial galleries such as Bitforms in New York and Carroll / Fletcher in London, which, acquire and show technology-based art. The Creative Machine exhibition is the first event to make use of Goldsmiths’ new Sonics Immersive Media Lab (SIML) Chamber. This advanced surround audiovisual projection space is a key part of the St James-Hatcham refurbishment. The facility was funded by capital funding from the Engineering & Physical Sciences Research Council (EPSRC) and Goldsmiths, as well as research funding from the European Research Council (ERC). This is connected respectively to the Intelligent Games/Game Intelligence (IGGI) Centre for Doctoral Training, and Atau Tanaka’s MetaGesture Music (MGM) ERC grant. The space was built by the SONICS, a cross-departmental research special interest group at Goldsmiths that brings together the departments of Computing, Music, Media & Communications, Sociology, Visual Cultures, and Cultural Studies. It was designed in consultation with the San Francisco-based curator, Naut Humon, to be compatible with the Cinechamber system there. During Creative Machines, we shall see, in the SIML space, multiscreen screenings of work by Yoichiro Kawaguchi, Naoko Tosa, and Vesna Petresin, as well as a new immersive media work by IGGI researcher Memo Akten

Point-based medialness for 2D shape description and identification

Abstract We propose a perception-based medial point description of a natural form (2D: static or in articulated movement) as a framework for a shape representation which can then be efficiently used in biological species identification and matching tasks. Medialness is defined by adapting and refining a definition first proposed in the cognitive science literature when studying the visual attention of human subjects presented with articulated biological 2D forms in movement, such as horses, dogs and humans (walking, running). In particular, special loci of high medialness for the interior of a form in movement, referred to as “hot spots”, prove most attractive to the human perceptual system. We propose an algorithmic process to identify such hot spots. In this article we distinguish exterior from interior shape representation. We further augment hot spots with extremities of medialness ridges identifying significant concavities (from outside) and convexities (from inside). Our representation is strongly footed in results from cognitive psychology, but also inspired by know-how in art and animation, and the algorithmic part is influenced by techniques from more traditional computer vision. A robust shape matching algorithm is designed that finds the most relevant targets from a database of templates by comparing feature points in a scale, rotation and translation invariant way. The performance of our method has been tested on several databases. The robustness of the algorithm is further tested by perturbing the data-set at different levels

Medialness and the Perception of Visual Art

In this article we explore the practical use of medialness informed by perception studies as a representation and processing layer for describing a class of works of visual art. Our focus is towards the description of 2D objects in visual art, such as found in drawings, paintings, calligraphy, graffiti writing, where approximate boundaries or lines delimit regions associated to recognizable objects or their constitutive parts. We motivate this exploration on the one hand by considering how ideas emerging from the visual arts, cartoon animation and general drawing practice point towards the likely importance of medialness in guiding the interaction of the traditionally trained artist with the artifact. On the other hand, we also consider recent studies and results in cognitive science which point in similar directions in emphasizing the likely importance of medialness, an extension of the abstract mathematical representation known as ‘medial axis’ or ‘Voronoi graphs’, as a core feature used by humans in perceiving shapes in static or dynamic scenarios.We illustrate the use of medialness in computations performed with finished artworks as well as artworks in the process of being created, modified, or evolved through iterations. Such computations may be used to guide an artificial arm in duplicating the human creative performance or used to study in greater depth the finished artworks. Our implementations represent a prototyping of such applications of computing to art analysis and creation and remain exploratory. Our method also provides a possible framework to compare similar artworks or to study iterations in the process of producing a final preferred depiction, as selected by the artist

The Effect of Spatial Design on User Memory Performance Using the Method of Loci in VR

Based on the Method of Loci, the following experiment compares the effect of two different virtual environments on participants' memory performance. The primary task consists of remembering a sequence of random playing cards. Each virtual environment is based on a different architectural style with a different layout. One is inspired by a Palladian style architecture, and the other by a Modern curved architecture

Computational Models for the Analysis and Synthesis of Graffiti Tag Strokes

In this paper we describe a system aimed at the generation and analysis of graffiti tags.We argue that the dynamics of the movement involved in generating tags is in large part — and at a higher degree with respect to many other visual art forms — determinant of their stylistic quality. To capture this notion computationally, we rely on a biophysically plausible model of handwriting gestures (the Sigma Lognormal Model proposed by Réjean Plamondon et al.) that permits the generation of curves which are aesthetically and kinetically similar to the ones made by a human hand when writing. We build upon this model and extend it in order to facilitate the interactive construction and manipulation of digital tags. We then describe a method that reconstructs any planar curve or a sequence of planar points with a set of corresponding model parameters. By doing so, we seek to recover plausible velocity and temporal information for a static trace. We present a number of applications of our system: (i) the interactive design of curves that closely resemble the ones typically observed in graffiti art; (ii) the stylisation and beautification of input point sequences via curves that evoke a smooth and rapidly executed movement; (iii) the generation of multiple instances of a synthetic tag from a single example. This last application is a step in the direction of our longer term plan of realising a system which is capable of automatically generating convincing images in the graffiti style space